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Education Consolidation and Improvement Act - Chapter 1 

F IIJAL EJ^ALUATION REPp_RT 
LANGUAGE DEVELOPMENT, COMPONENT 
CLEAR-READING RECOVERY PROGRAM 
March 1987 

Abstract 



P r;>gr aia^ I^e^& r i p t i mu The CLEAR-Reading Recovery Program (CLEAR-RR) served 224 
pupils in first grade. Funding of the program was made available through the 
Education Consolidation and Improvement Act - Chapter of 1983, 

The purpose of CLEAR-RR is to provide early interveritiori to underachieving 
first-grade pupils who appear unlikely to learn to read successfully, without 
intensive instruction. To accomplish this purpose CLEAR-RR features 
individualized one-to-one lessons thirty minutes daily provided by specially 
trained teachers. The lessons are based upon diagnostic instruments designed 
to provide a cqmpreheiiBtve assessment of the pupil's developiaent in reading and 
writing strategies. The program, based upon the Reading Recovery Program of 
New Zealand which was developed by Dr. Marie Clay^ is a joint effort of 
educators in Columbus Public Schools, The Ohio State Univeisity , and the Ohio 
Department of Education. Data from the New Zealand program indicated that 90% 
of the pupils were recovered. 

CLEAR-RR was located in 12 elementary schools with a total of 30 teachers 

serving four or more pupils daily, normally for oue-half day^ while working as 
first-grade teachers for the other half of the day. 

Time Interv-al : For evaluation purposes CLEAR-RR ran from September 30, 1985 
thru June 3, 1986. Pupils included in the final pretest-posttest analysis must 
have had 60 or more instructional lessons or were discontinued , that is ^ 
successfully completed the program. 

Activities ; implementation of CLEAR-RR was accomplished through daily 30 
minute lessons, during which the pupils were engaged in a variety of 
activities, namely, reading and re-reading books while the 
teacher maintained a record of their strategies and errors, writing and reading 
their own stories, letter identification, and sound analysis of words. 

Achievement Obj e ctive^z Pupils were to receive instruction in the program long 
enough to be discontinued f rom CLEAR-RR. Discont inucd pupils were those who 
successfully completed the program according to the predetermined levels on 
diagnostic measures. They were to have made sufficient progress to work in the 
normal classroom setting without further need for individual help. 



Evaluation Design ; Questions regarding the success of the program were based 
upon two major goals: to develop and provide CLEAR-RR for first-grade pupils j 
and to adapt and apply the necessary inservice program for teachers. Question 
i J What were the performance levels of pupils discontinued or with 60 or more 
lessons on a standardized test of reading? Question 2; What were the pretest 
_P^_^_^^^^^ -^^.^^-^^ performance of pupils on the six diagnostic measures 
employed in Reading Recovery? Question 3; How do CLEAR-RR pupils, compare to 
pupils in other compensatory programs? Question 4: What were the costs of 
CLEAR-RR corapared to other compensatory programs? Question 5: What were the 
long term effects of CLEAR-RR ? Question 6: What were the service patterns of 
CLEAR-RR? 



E VALSRVCS/ P50 1 / CRRAB STXX 
RSViSJSD 04/22/87 



3 



The major evaiuatiori ieffbrt was accomplished through two types of tests: 
the administration of the Reading Recovery Diagnostic Survey which yields 
scores and gains in letter idierttificatidn, word tests ^ concepts about prints 
writing vocabulary, dictation, and text reading levels; and the administration 
of the vocabulary and comprehension subtests of the Comprehensive Tests of 
Basic Skills (GTBS) , Levels B and C. Analyses of the standardized test data 
included comparison of Total Reading change scores, pretest to posttest^ in 
terms of percentile and NCE scores. Locally constructed instruments were 
developed to obtain enrollment/attendance data. 

Major F i xtdin^jKQ c o mme n d a t i o n S-^ Analysis of data indicated that 285 
first-grade papils were selected to be served , of which 224 actually received 
servicei^ The average enrollment was 89.0 days; the average attendance was 70.9 
^^y^'* "l'^™^^.^ instructional lessons was 60.6; while the average 

daily membership was 125.4 pupils. 



A total of 155 pupils were either discontinued (J 04) or received 60 or more 

lessons (51). this group, the evaluation sample with both a CTBS pretest 

and posttest consisted of 141 pupils. 



A review of the _4^ta indicated that the median percentile score in Total 
Reading was i6i0 ^A^_ _P^^_^^^^ 28.0 on the posttest. The mean NCE score 

was 28.0 on the Pi^^itest and 36.5 on the posttest. Therefore, the average 
growth was 8i5 NCE points i The number and percent of pupils who were at 
various percentile levels on the posttest are as follows: (a) 28 or 19.9% were 
at the 50%ile or above (grade level); and (b) 86 or 61.0% were at the 36%ile or 
below (Chapter 1 eligible). 

^y^^^3^_ made by the sample of 141 CLEAR-RR pupils 

compares favorably with the 0.9 NCE gain made by the sample of 103 first-grade 
pup±ls enrolled in the regular public school CLEAR program and the 0.2 NCE gain 

A^^_ sample of 1185 Instructional Aide pupils. However, when pupils 
scoring below the 37%iie on the pretest were compared, it was found that the 
average NCE growth for CLEAR-RR was 12.1, for regular public school CLEAR the 
average gain was 7.1 NCE points, and fojr the Instructional Aide pupils the NCE 
growth was 3.6. For the pupils scoring below the 37%ile on the pretest, the 
cost per_ NCE point gain was $342 for CLEAR-RR, $140 for regular public school 
'jLEAR, and $262 for the Instructional Aide group. 

On the Reading_Recovery Diagnostic Survey, the following mean scores were 
obtained for September and ^ay from a sample of 144 CLEAR-RR pupils who were 
discontinued or had 60 or more instructional lessons: Letter Identification, 
34.87 to 51.56; Word Test, 2.02 to 13.24; Concepts About Print, 7.31 to 16.05; 
Writing Vocabulary, 2.96 to 33.25; Dictation, 5.24 to 30.16; Text Reading 
Level, 1.77 to 9.53. 

Data regarding long term effects from early February, 1987 indicated that 
of the 155 p_upiis who were discontinued or had 60 lessons or more, 40 (25.8%) 
were retained in first grade. Also, of the 155 pupils, 67 were in a school and 
at a grade level where a compensatory program was serving other pupils. Of the 
67 pupils, 20 (29.9%) were being served in a compensatory program at that 
school; 



Recoiranendations were to continue CLEAR-RR at its current level; to share 
the successful teaching techniques and development of successful pupil reading 
strategies with teachers in other programs; and to investigate the 
possibilities of providing services to more pupils with the current staffing 
levels . 
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_ >\INAL _E VALUATION REPORT 
LANGUAGE DEVELOPMENT COMPONENT 
CLEAR-READING RECOVERY PROGRAM 
1985-86 



Program Descriptio n 

The purpose of the Compensatory Language Experiences and Reading - Reading 
Recovery (CLEAR-RR) Program is to_ provide e_arly intervention to underachieving 
first-grade pupils Who appear unlikely to learn to read successfully without 
intensive instruction. To accomplish thJs purpose the program features 

individualized one-to-one lessons 30 minutes daily provided by specially trained 
teachers. The lessons are based upon diagnostic instruments which are designed to 
provide a comprehensive assessment of the pupil's development in reading and 
writing strategies. 

The CLEAR-RR Program first operated as a pilot project during the 1984-85 

school year. The Columbus Public Schools is the first school system in the United 
States to attempt a program similar to Reading Recovery that was developed in New 
Zealand by Marie Clay^ a renowned psychologis t and educator. The CLEAR-RR Program 
was initiated as a joint effort of educators in Columbus Public Schools, The Ohio 
State University (OSU)^ and the Ohio Department of Education (ODE), with 
assistance by Dro Clay and others from New Zealand, 

Dr. Clay's early intervehtibh strategies have been employed increasiingly in 
New Zealand since 1976^ with the result that children at risk of reading failure 
throughout the years have made exceptional progress in learning to read. Often, 
as many as 90% of the pupils were able to work within the average range in their 
classtddms aftier approximately 12 to 14 weeks of individual tutoring (Clay, 1985)i 
Dr. Clay's Reading Recovery Program fits in well with the whole language 
approaches used to teach all children to read in New Zealand which is, according 
to BecgjfeLng a Nation of Readers (Anderson, Hiebert, Scott, & Wilkinson, 1985), the 
most literate country in the world. 

In 1984-85 the project operated in six elementary schools, served 
approximately 70 children^ and was staffed by 14 CLEAR-RR teachers, three teacher 
leaders from the school system^ and university personnel, all of whom worked 
individually with pupils in the Reading Recovery project. 

In 1985-86 the CLEAR-RR Program was expanded to consist of 30 teachers, each 
working with four or more pupils daily_ plus_ 11 additional personnel working with 
one or two pupils daily. Officially^ CLEAR-RR had 16 full-time equivalent 
teachers. Normally a CLEAR-RR teacher worked, as a first-grade teacher for a 
^^^^"^•^y served individual pupils for 30 minutes, each during the other 

half-day. Two CLEAR-RR teachers worked with individual pupils for the entire 
day. The program served a total of 224 pupils in the following 12 elementary 
schools. 



S c h b b 1 s Served by the 

CLEAR-Reading Recovery Program 



Avaldn 
Beck 

Burroughs 
Clarfield 
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Fairwood 



Hubbard 
Linden 
Medary 
Pilgrim 
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In eoiambas Public Schools the format for diagnosis developed by Dr. Clay and 
others is followed closely with_ minor "revisions. At the beginning of the school 
year first-grade pupils (in some classes the entire class, in others the lower 
half of the class) take a d.** agnostic survey of reading and writing tests: Letter 
Identification, Ohio Word fest, Concepts about Print, Writing Vocabulary, 
Dictation Test, and Text Readingi These tests are also administered at various 
times throughout the year as pupils enter or exit the program and again at the 
conclusion of the year to CLEAR-RR participants and other selected pupils. 

Pupils are selected for the CtSAR-RR Program on the basis of low diagnostic 
test scores which indicate that they are not likely to learn to read successfully 
in a regular classroom environmenti Selection occurs prior to the program 
norm-referenced pretest. 

Each pupil entering the program spends approximately the first 10 days 
"Roaming In the Known." During this period the CLE AR-RR teacher builds rapport 
V7ith_ the_ pupil and provides an opportunity for the pupil_to use the strategies the 
pupil already knows in meaningful reading and writing activities. Once the 
Reading, Recovery lessons begin, a familiar pattern is established. A typical 30 
minute Icsjjon includes most or all of the following activities. 

1. Two or more familiar books selected by the pupil are read to the teacher. 

2. The teacher makes a running record _af the book attempted by the pupil the 
previous day. During this time the CLEAR-RR teacher changes the focus 
from instruction to scientific observation. Meaning, structure, and 
visual cues are analyzed to determine which cues are used or neglected by 
the pupil. the teacher carefully records each day the development of 
reading strategies by the pupil. 

3. During letter identification, plastic letters are used on a magnetic 
board. 

4. The pupil writes a story with the teacher's help. 

5. During sound analysis of words, the pupil is encouraged to say the word 
slowly and write what can be heard. 

6. A cut-up story is rearranged by the pupil. 

7. A new book is introduced by the teacher. 

8. The new book is attempted by the pupil. 

When it is determined by the CLEAR-RR teacher, in consultation with the 
classroom teacher and the Reading Department team leaders, that a pupil has made 
sufficient progress to work in the normal classroom setting without individual 
help, the pupil is recommended to be discontinaed. Discontinued pupilis are 
defined as those who have successfully completed the program according to the 
predetermined levels on diagnostic measures and have been released from the 
program. Other pupils from the waiting list enter the program when pupils are 
discontinued or move from the school. 
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Evaluation Design 

As of the second year of the project, no specific evaiaation objectives had 
been determined. An evaluation design was developed based on two goals identified 
from the 1984-85 proposal: 

1. To develdi5 and provide the CLEAR-RR Program for first-grade 
pupllis • 

The individual child who has been identified as being "at risk" 
of failure has recovered essential reading strategies and can 
function satisfactorily in the regular classroom. 

2. To adapt and apply the necessary inservice program for teachers. 

To implement the Reading Recovery techniques , teachers wiii 
receive intensive training over the period of a year while 
simultaneouisly implementing the program with children through 
clinical and peer-critiquing experiences guided by a skilled 
instructor. 



Based on these two gbals^ evaluation _ q_ues*:ions regarding the tt,EAR-RR Program 
were developed^ The questions are as follows: 

Qaes^loal What are the performance levels of_ pupils discontinued or with 60 or 
more lessons on a standardized test of reading? 



Analysis 1.1 
Analysis 1.2 
Analysis 1.3 



Number and percent of pupils reaching the 50%iie on the 

Total Reading arid Reading Comprehension Scores on the GTBS. 

Number and percent of pupils reaching the 37%ile on the 

Total Reading and Reading Comprehension Scores on the CTBS. 



Number and percent of pupils reaching the average MCE for 
their room (schoolwide cla_ssrooms only) on the Total Reading 
acid Reading Comprehension Scores on the CTBS. 



Analysis 1.4 Mean or median charige in %ile or NCE rank. 

Question 2 What were the pretest and posttest _ levels of performance of pupils 
on the six diagnostic measures employed in CLEAR-RR? 



Analysis 2.1 



Descriptive data (mean, median, s.d.) on pretest and 
posttest. 



Analysis 2.2 Comparison of text reading levels of pupils pre and post 
using appropriate non parametric statistics. 
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Q uas^ion 3 How do CLEAR-RR pupils . compare to pupils in other compensatory 
programs meeting autendance criteria? 

Analysis 3.1 Number and percent reaching the 37%ile on the CTBS at 
posttest time. 

Analysis 3.2 Comparison of distribution of posttest CTBS scores using the 
KolmogorovSmirnov statistic. 

Analysis 3.3 Comparison of text reading levels with pupils in uhe 
Instructional Aide sample, 

gu£s£4£n_4 What were the costs of CLEAR-RR compared to other compensatory 
programs? 

Analysis 4.1 Cost per pupil of each program^ 

Analysis 4.2 NCE gain in reading for each program. 

Analysis 4.3 Cost of gain of 1.0 NCE point for each program. 

Question- 5 What are the long term effects of CLEAR-RR? 

Analysis 5.1 Number and percent of pupils served by CLEAR-RR in 1985-86 
who attended a_ school where a compensatory program was 
available and who were served by a compensatory program in 
1986-87. 

Analysis 5.2 Number and percent of students served by Reading Recovery in 
1985-86 who followed a normal grade level progression. 

Queg^i4>n^6 What are the service patterns of CLEAR-RR? 

Analysis 6.1 Number of pupils selected for the program who were . not 
served. 

Analysis 6.2 Number of pupils who were served. 

Analysis 6.3 Number of pupils who were discontinued. 

Analysis 6.4 Demographic characteristics of pupils who were served^ 

Analysis 6.5 Demographic characteristics of pupils who were discontinued.' 

The evaluation design provided for the collection of data in the following 
seven areas of operation for the overall program. 

The- Sep timber ^n^^Mi^at i on Fo r m lists all pupils who were given the 
diagnostic tests at the beginning of the school year. Pupils most in 
need of CLEAR-RR services were selected from this list by Reading 
Department Personnel. 
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2i The Reading Recovery Papii Test -Rosier lists all pupils who were to be 
selected for service during the 1985-86 school year and were to be 
given the GTBS pretest in October 1985. Additional pupils were placed 
on the list to be served in the event that extra openings became 
available. 

3i The CLEAR-Reading Recovery Serviae-J'xxnn is completed by each CLEAR--RR 
teacher upon official entry of each pupil into the program. 



A. The CLEAR-Reading^ Recovery Data^ JForm is used by program teachers to 
keep enrollment/attenda,nce ^ata for each pupil served as well as 
diagnostic and service patterns i 

^* The GLEAR--Reading Recovery Posttest Ros4:er is a computer printout sent 
to CI'EAR^RR teachers to verify whTch pupils would take the GTBS 
postcest in April 1986. 

6. The May laformacion Form is a computer_ printout liisting of all pupils 
who were to receive the battery of diagnostic tests similar to those 
administered at the beginning of the year. 

7. The Comprehensive Tests of Basic Skills (CTBS, 1981) was used as the 
pretest and posttest for ail pupils in CLEAR-RR. This test series has 
empirical norms for fail and spring,_ established October 6- 10, 1980, 
and April 27 to May 1, 1981. The description of the CTBS pretest and 
posttest is as follows: 

Recommended Number 
Level Form Grade Range Subtes-ts of Items 

Pretest B U K.6-1.6 Vocabulary 17 

Oral Gomprehension 15 
Total Reading 32 

Pcstest C U 1.0^1.9 Vocabulary 25 

Reading Comprehension 25 
Total Reading 50 

_ The CTBS tests were administered by program teachers except in schools where 
schoplwide testing occurred. Pretesting occurred September 30 through October 
4, 1985. Posttesting occurred April 21-30, 1986. All testing was done 
on-level, as indicated in the u^blo above. 

Major Findings 



Question 1 What are the perfdrmahce levels of pupils discontinued or with 

60 or more instructional lessons on a standardized test of reading? 
(Discontinued pupils are defined as those who have successfully 
completed the program according to predeterminea levels on 
diagnostic measures and have be'^n released from the program.) 

Analysis 1.1 l^iumber and percent of pupils reaching the 50%iie on the 
Total Reading and Reading Comprehension Scores on the CTBS, 
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Analysis 1.2 Number and percent _of pupils reaching the 37%ile oh the 
Total Reading and Reading Gomprehension Scores dri the CTBS. 

Analysis 1,3 Number and percent of pupils reaching the average NCE for 
their room (schoolwide classrooms only) on the Total Reading 
and Reading Comprehension Scores on the GTBS. 

Analysis 1.4 Mean or median change in %ile or NCE rank. 

The evaluation sample for the standardized test data results was limited to 
those pupils who h ;d both pretest and posttest _ administrations of the 
standardized achievement test and were either discontinued or had a rainimum of 
60 lessons. The use_ of the 60 lesson criterion was based upon the premise in 
Clay's study which determined that an average of 60 lessons was needed for 
pupils to be discontinued and continue to work successfully in the normal 
classroom setting. Of the 224 pupils served, an insufficient number of lessons 
or missing test data, reduced the sample to 141 pupils which was 62.9% of all 
pupils served. Data from standardized testing are presented in Tables 1 and 2. 

The results of Analysis 1.1 and 1.2 done with the evaluation sample data 
showed that for Reading Comprehension 22.7% of the pupils scored at grade level 
Oh the posttest and 39,0% scored above the 36%ile. For Total Reading, 19.9% of 
the pupils scored at grade level on the posttest and 39*0% scored above the 
36%ile. An examination of pretest scores revealed that 27_ of the 141 pupils had 
scored above the 36%ile (Chapter 1 eligibility cutoff .scored and 15 had actually 
scored at or above grade level on the pretest. Therefore an analysis was done 
with just the pupils who had Total Reading pretest scores below the 37%lle. The 
analysis showed that of the 114 pupils 75 (65.8%) had posttest scores below the 
37%±le on Total Reading. 

The results of Analysis 1,3 are as follows. in the.five CLEAR-RR schools 
where schoolwide testing occurred, 1597 first-grade pupils were tested in April 
1986. The mean NCE foT .Reading Comprehension was 44.6, and for Total Reading it 
was 43.6. The number of CLEAR-RR pupils from the evaluation sample who reached 
or exceeded the average NCE for their classroom in Reading Comprehension was 19 
of 51 pupilsor 37,3%. ln_ Total Reading 20 of 51 or 39.2% reached or exceeded 
the average NCE for their classroom. 

Because certain pupils V7ere _ in the sample by virtue of the fact that they 
were discontinued or had their 60 lessons after the posttest was administered, 
an analysis was made of certain subgroups of the evaluation sample. The results 
of Analysis 1,4 are found in Table 3, The pupils who made the highest gains of 
18.9 NCE points were those 49 pupils who were discontinued by the time the 
posttest was administered. The second highest gain of 16.5 NCE's was iade by 
the 73 discontinued pupils who were below the 37th percentile on the pretest. 
All subgroups made higher gains than did. the total evaluation sample including 
chose 100 pupils discontinued or with 60 lessons by posttest time with a gain of 
10.8 NCE's. 

Que&tlon— 2 What were the pretest and poGttest levels of performance of pupils 
on the six diagnostic measures employed in Reading Recovery? 

Analysis 2.1 Descriptive data (mean, median, s.d.) on pretest and 
posttest. 

Analysis 2.2 Comparisor. of text reading levels of pupils pre and post 
using appropriate non parametric statistics^ 
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Table 1 

CLEAR-Reading Recovery, 1985-86 
Minimuni, Maxiniuni, Average, and Standard Deviation of the 
Pretest and Posttest Normal Carve Equivalent!; (NCE) 
for Comprehension and Total Reading 
N=l4l 



Subtest- 



Pretest 



Min. Max. 



Mean 
NCE 



Standard 
Deviation 



Posttest 



Mean Standard 
Min. Max.._tJCE - Deviation 



Change 



NCE 



Standard 
Deviation 



Oral 

Comprehension 
(Fail only) 

Reading 
Comprehension 
(Spring only) 

Iota: 



82 30.6 16.2 



81 28.0 16.1 



I 86 37.6 17.1 



1 78 36.5 16.0 



8.5 



17.8 



12 

11 



^ E£J£ S/P501/RRFINAL 
04/22/87 



Table 2 

_ CLEAR-Reading Recovery, 19^^^^ 

MiniBum, Maxiiiiuni, Median, and Quart lie Deviation 

of Pretest and fosttest Percentiles for Oral and Reading Comprehension and Total Reading 

N=14I 



Pie ten - 



Subtest MininiQin Maximom 

Oral 

Comprehension 3 94 
(Fall only) 

Reading 
Conpreherisibii 
(Spring only) 

Total Reading 1 93 



Quartile 

Lie — De-viation 



16 



9.0 



16 



10.( 



Posttest 



Median Qnartile 
HiPiM Maximum Percentile Deviation. 



96 



91 



30 



28 



17.0 



16.5 



13 



14 

CO 
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CLEAR-Readiiig Recovery, 1985-86 
Average and Standard Deviations of the Pretest and Pbsttest 
Normal Curve Equivalents (NCE) for Total Reading of Subgroups 



Sabgrogp 



Discontinued 
by Posttest Time 



J 'rg te st 



Median Average Standard 

t-Xih NCE — B^viati^n- 



49 19 



30.2 14.8 



47 



Pbsttest 



Median Average Standard 
UU NCE Deviation 



49.1 



10.3 



Change 



Average Standard 
NCE Deviation 



18.9 i4.8 



Discontinued 
or 60 Lessons 
by Posttest Time 



100 14 



26.8 15.2 



30 



37.6 



16.3 



10.8 17.5 



Discontinued 
or 60 lessons 
by Posttest Time 
CIX on Pretest 



83 11 



21.9 12.4 



28 



35.7 



16.3 



13.9 16.6 



Discontinued 
or 60 Lessons 
<37^ on Pretest 



114 11 



22.3 11,8 



25.5 34.4 



15.8 



12.1 



16.7 



Discontinued 
<372 on 
Pretest 

Discontinued 



73 13 
98 19 



24.8 
31.8 



10.1 
15.3 



38 



41 



41.4 



42.9 



13.3 



13.1 



16.5 15.6 



ll.i 17.5 



" it 
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Five diagnostic instruments adapted from Clay^s Diagnostic Survey and a 
sixth one measuring text jreadirig levels were administered in September and May 
to all pupils in CLEAR-RR. Pupils were assessed in their ability to (a) 
identify 54 upper and lower case letters, (b) read a list of 15 basax words, ^c) 
perform tasks related to 24 concepts about prints (d) write all the words they 
knew in 10 minutes, (e) write the words in a dictated sentence comprised of 37 
sounds, and (f) read successive levels of texts to determine the highest level 
of success which was designated as text read with 90% accuracy or above. The 
highest or 26th level was equated to tHe sixth grade reading level in the basal 
reading series used by the school district. A summary of the data from the 
pretest and posttest of the diagnostic measures is presented in Table 4i 

The data indicated that a sample of 144 pupils discontinued or with 60 or 

more lessons made substantial gains in all measures and approached the raaxiraam 
possible scores in two measures^ namely Letter Identification and Word Test. in 
Letter Identification the average pretesfto-posttest scores were 34.87 and 
5i.56,_ an increase in 16.69 letters. On the Word Test the average 
pretest-to-i50Sttest scores were 2.02 and 13.24, an increase in 11.22 words. in 
Concepts About Print the average pretest-to-ppsttest: scores were 7«3i and 16.03, 
an_ in_jrease in 8.74 concepts. In W_riting Vocabulary the average 

pretest-to~posttest scores were 2.96 and 33.25, an Increase in 30.29 words. in 
Dictation the average pretest-to-posttest scores were 5.24 and 30.16, an 
increase in 24.92 sounds. In Text Reading the average pretest-to-posttest 
scores were 1.77 and 9.53^ an increase in 7.76 levels. According to the results 
of the Wilcdxon Matched-Pairs Signed-Ranks Test, the GLEAR-RR pupils had 
statistically higher (£<.001) Text Reading levels on the posttest. 

QxxestXon 3. How do CLEAR-RR pupils compare to pupils in other compensatory 
programs meeting attendance criteria? 

Analysis 3.1 Number and percent reaching the 37%ile on the CTBS at 
posttest time. 

Analysis 3.2 Cdmparrvson of disr.ribution of posttest GTBS scores using the 
Kolmbgorov-Smirnov statistic. 

Analysis 3.3 Comparison of text reading levels with pupils in the 
Instructional Aide sample. 

A cdmpiirison was made among the sample of 141 GLEAR-RR pupils, a regular 

CLEAR sample of 147 first-grade pupils^ and aa Instructional Aide Program sample 
of 1185 first-grade pupils. Test data regarding the three programs are found in 
Table 5. 

Numerous differences can be cited among the three groups. For example, the 

GLEAR-RR sample pupils were discontinued or had 60 or more lessons, the regular 
GLEAR group attended 108 or more program days ^ and the Instructional Aide sample 
group attended 118 or more program days. Instruction for GLEAR-RR was one to 
one, whereas small group instruction of 10-12 pupils occurred in the other 
P^^Srams. The pretest median percentile and mean NGE scores were lower for 
GLEAR-RR than the other two groups. At posttest time the CLEAR-RR group 
surpassed the Instructional Aide group but not the regular CLEAR group on the 
median percentile and mean NC_E__ scores. GLEAR-RR pupils made substantially 
greater average gains of 8.5 NGE points in comparison to the regular GLFAR's 
gain of 2.6 NGE points and the Instructional Aide group's gain of 0i2 NGE 
points. The percentage of pupils making substantial improvement for GLEAR-RR 
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Table 4 

CLEAR-Readiiig Recovery j 1985-86. 
Average Pretest and Posttest Levels j Standard Deviations, 
and Average Change Scores on the 
Diagnostic Survey 



Diagnostic P retest Pocttest Change 

Measure 41in. Max. M^-Mn S.D. Min. Hay. Hed. Mean S.D. Mean S.D. 

Letter Identification 

(Max. 54 letters) C 54 39 34.87 15.01 23 ; 54 52 51.56 3.89 16.69 13.64 



Word Test 

(Max. 15 words) 0 14 2 2.02 2.23 2 15 14 13.24 2.45 11.22 2.72 
Concapts -Mut Print 

(Max„ 24 concepts) G 21 7 7.31 3.75 5 22 16 16.05 2.90 8.74 3.78 

Writing Vocabulary 
(Max. Words in 

10 Minutes) 0 18 2 2.96 2.87 5 69 32 33.25 13.64 30.29 13.00 
Mctation 

(Max. 37 sounds) 0 27 4 5.24 5.82 9 37 32 30.16 6.78 24.92 6.95 
Text Reading 

(Max. 26 levels) 1 4 2 1.77 0.85 3 26 10 9.53 3.28 7.76 \23 




Table 5 



Comparison of CIEAR-Reading Recovery iapils with First-Grade Pupils 
in Regular CLEAR and the Instructional Aide Ptjgram 
on Total Reading, 1985-86 



- - - -^^^^^^^ Postcest p soniea Substantlaia 

'^^^^^ Median Mean Median Mean Average iiprovement Iniproveiiient Improvement 

Program N me NCE. tile NCE . NCE N N N 
- <Q'D-) (S.D.) (Q.D.) (S.D.) Change {t of Total) -(Xoi-Iotal) q^f Total) 

CLEAR-RR 141 16.0 28.0 28.0 36.5 8.5 45 14 82 

(10.0) (16.1) (16.5) (16.0) (31.9^) (9.gX) (58.2^) 



CLEAR 147 34.9 41.3 44.3 2.6 57 31 59 

(19.0) (16.3) (17.0) (14.3) (38.8^) (21. IZ) (40.1 



tnEtructionai 

Ai^le 1185 21.5 33.5 22.5 33.7 0.2 666 161 418 

(13.5) (15.1) (15.5) (16.7) (51.1^) (13.6?) (35.3Z) 



^No Improvement = 0 or less NCE gain 
Some Iraprdvement = 1 to 6 NCE gain 
Substantial Improveinent = 7 or more NCE gain 
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was. also much higher than the other two groups respectiveiy (58.2%, 40. 1%^ 
35.3%). At posttesc time the percentages of GLEAR-RR pupils no longer eligible 
for Chapter 1 because of placing at or above the 37th percentile fell between 
the other two groups respectively (39.0%, 57.8%, and 29.7%). 

Because pupil selection criteria were to result in extreme groups of pupils 
being selected for the various compensatory programs that serve first-grade 
pupils^ there was some interest in determining the characteristics of the 
distributions of pretest, posttest and change scores. Analysis 3,2 was carried 
but by means of the Kblmb^orov-Smirnov goodness of fit test and graphic displays 
which indicated that_ the CTBS distributions were essentially normal for 
CLEAR-'RR^ public school CLEAR and the Instructional Aide Programi 

An examinatibh of _ the pretest NCE scores for CTBS Total Reading indicated 
that the groups were dissimilar at the! start of the project yeari The average 
pretest NCE score for CLEAR-RR_ was 28.0, while the average pretest score for 
public schbbl CLEAR was 43.4. The comparable figure for the instructional Aide 
Program was 33.5. The posttest scores indicated that the CLEAR-RR and public 
school CLEAR groups were also dissimilar at the end of the project year. The 
average NC_E score for pupils in the public s-hool CLEAR group was 44.3 and the 
average NCE for the CLEAR-RR group had _increac?ed to 36.5. The comparable figure 
for the Instructional Aide Program was 33.7. 

ArialysiJ 3.3 provided, a comparison of the performance of two groups of 
pupils on Text Reading. Group 1 was composed of 144 CLEAR-RR pupils who were 
discontinued or had 60 br more lessons, and had both a pretest and a posttest 
Text Reading score. Group 2 was composed of 44 pupils in the instructional Aide 
evaluation samf^le who had both a pretest and a posttest Text Reading score. The 
analysis showed that CLEAR-RR pupils scored significantly lower (£<.01) on the 
pretest than Aide pupils with average scores of 1.8 and 2,3 respectively. On 
the posttest^ however^ the CLEAR-RR pupils scored significantly higher (£<.01) 
than the Aides_ pupils with average .scores of 9.5 and 7,6 respectiveiy. On the 
average the CLEAR-RR pupils gained 7.8 Text Reading levels and the Aides pupils 
gained an average bf 5.3 Text Reading levels. 

Question 4 What were the costs of CLEAR-RR compared to other compensatory 
programs? 



Analysis 4.1 Cbst per pupil of each program. 
Analysis 4.2 NCE gain in reading for ^ach prograii 



Analysis 4.3 Cbst of gain of 1.0 NCE point for each program. 

A cost-benefit analysis was prepared in order to compare the three programs 
serving first-grade pupils_ (CLEAR-RR, regular CLEAR, and Instructional Aide). 
The results are given in Table 6. The subgroup of first-grade regular CLEAR 
pupils was redefined. tP include only public school pupils, which changed the 
number of sample pupils from 147 to 103. Non-~public school pupils were 
eliminated frbin this sample for greater ccmparnMlity of groups and for 
congruence with other cbst-benef it studies previously used in Columbus Public 
Schools Chapter 1 Programs. When the three groaps of pupils were compared and 
pp9p»fburid tb be dissiraiiar at pretest tiite in terms of NCE scores, a further 
tl^^subgrbup of pupils who scored at or below the 36th percentile was analyzed; 
This analysis was performed in order to compare subgroups who were ail Chapter 1 



•^strtenef it Srialysis for FlrGt-Grade Public Scfebl Pupils in 
Qiapter i M Reading te^^^ Chapter 1 Regular CliAR, and 
the DPPF First-<;rade Instructional Aide Prograu 



Popt fe I n Program ^pilsjerFT^ m per Pupil Eio^f" Average mtfU 

M- - Senred In SaBple- Served In Sample Served In Sample Pupils Served JSain - -ted 



Total 



mm 16.0 $581,978 $36,374 224 141 14.0 8.8 $2.^98 $4,12£ 62.9? 8;5 $485 

{I^ils<37me ' '^'^ ^' 

on Pretest) 



(Pupils Qime 
OQ Pretest) 



2.8 101,846" 36,374 147 103 52.5 36.8 693 989 70.1 ();9 1,061 

^5 989 7.i 140 



Instr. 

Aide 100.5 l,113,505C 11,680 1,897 1,185 iO.9 11.3 587 940 62.5 0.2 4,508 



Instr. 

- - 871 940 

(Pupils <3:iifi 

im Pretest) . 



Me, Hk pipils in the evaluation sanples varied considerably across the three prograns in teniB of their 

pretest m Total te^ SMres._ Tte walysis of only pupils scoring below tl^ 37lile was Muded in an atten^ 
: to shw prcgram results oil more slidlar groups of pupils. 
^ Cost figure, include only teacher/aide costs. 
^ Figires are based on the proportion of pupils served at each grale level. 
^ Cost is based on naxiiiuii salary plus fringe benefits for aides. 
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eligible according tc the pretest, the resulting subgroups numbered 114 for 
CLEAR-RR, 49 for public regular CLEAR and 87i for the Instructional Aide 
Program* The data indicated tha the cost per pupil xn the evaluation sample was 
$4,128 for CLEAR-RR, $589 for regular CLEAR, and $946 for the instructional Aide 
Program. _The NCE gain in reading for the subgroups was i2il, 7,1, and 3.6 
respectively, _ The cost of the gain oz 1 NCE point was $342 for CLEAR-RR, $140 
for regular CLEAR, and $262 for the Instructional Aide group. 

Question 5 What are the long term effects of the CLEAR-RR Program? 

Analysis 5.1 Number and percent of pupils served by CLEAR-RR in 1985-86 
who attended a school where a compensatory program was 
available and who were served by a compensatory program in 
1986-87. 

Analysis 5,2 Number and percent of students served by Reading Recovery in 
1985-86 who followed a normal grade level progression. 

Data from early February 19_87 indicated that, of the 155 pupils discontinued 
or with 60 or more lessons^ 67 were in a school and at a grade level where a 
compensatory program V7as serving other pupils. Of the 67 pupils, 20 (29.9%) 
were served in a compensatory program at that schools Three additional pupils 
Tvere served by a compensatory program at another school. Of the 23 pupils, 17 
were served as second-graders by the CLEAR program and six were served as 
first-graders by rhe InstiTuctional Aide Program. Also, the Student Master File 
showed that of the sample of 155 pupil c , 40 (25.8%) were still in first grade. 

Question 6 What are the service patterns of CLEAR-RR? 

Analysis 6.1 Number of pupils selected for the program who were not 
served* 

Analysis 6,2 Number of ouplls who were served. 

Analysis 6.3 Number of pupils who were discontinued. 

Analysis 6,4 Demographic characteristics of pupils who were served. 

Analysis 6.5 Demographic characteristics of pupils who were discontinued. 

A total of 224 first-grade pupils was served in CLEAR-RR during the 1985-86 
school year for an average of 2,5 hours of instruction per week. The total 
number of boys and girls served was 136 and 88 respectively. The total numbe'r 
of pupils on free or reduced price lunch was 187. while 37 pupils were not 
receiving a subsidized lunch. The total number of Blacks served was 117 while 
the total number of non-blacks served was 107, The average daily membership in 
the overall program was 125,4 pupils. The average days of enrollment per pupil 
was 89.0 days and the average attendance was 70,9 days. The average number of 
lessons per pupil was 60.6, The average number of pupils served per teacher 
during the school year by the 16 full-time equivalent teachers was 14.0. 

Of the 104 discontinued pupils ^ 66 were male and 38 were female; 86 were on 
the free and reduced lunch plan while 18 were not; and finally, 51 were black 
and 53 were non black. 
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"ot 111 pupils served in the CLEAR-RR Projgram, 1C4 were considered 
discontinued based upon the combined judgment , of the CL2AR-RR teachers and the 
Reading _ Department teacher leaders who thoroughly analyzed all pupiis' 
diagnostic records plus their performance in the. classroom, Gf the 104 
discontinued pupils, 58 were officially discontinued during the school year, and 
46 were discontinued by tne teacher leaders at the end of the year although they 
had not yet been _recoffimended for discontinuing by their CL.:AR~RR teachers. Of 
the 224 pupils who were served, the breakdown of discontinued pupils and those 
pupils not discontinued by number of lessons is shown in Table 7, 

One of the concerns of the program planners i;^ how long to serve pupils who 

appear to make little progress after a lar^e number of lessons. The average 
number of lessons for the 104 discontinued pupils is 66,4 while the average 
number of lessons for the 120 non-discontinued pupils is 55,6„ It has been 
determined that approximately 60 lessons are necessary for most pupils to 
successfully complete the program. Therefore, an analysis was made of ail 
pupils who completed 60 or more lessons. The data indicated that of the il2 
pupils v7ho had 60 or more lessons^ 61 were discontinued and 51 were not 
discontinued. 

September, 1985 a total of 2Si3 first-grade pupils were designated to be 
served_ in the _eLEAR-RR Program at some time during the year. As pupils were 
discontinued or left the program for other reasons, new pupils were added. 
Table 8 indicates the numbers of pupils not served and the reasons why. 

^fi^j.i^^Sest number of pupils not served _ were the emergency pupils, so 
designated because they were in the classroom of the CLEAR-RR teacher teai, were 
at a siightiy_ higher level than the first eight or nine pupils to be served from 
that classroom, and would only receive service in the beginning of the year if a 
pupil from their classroom left the program, before pupils were served from other 
classrooms* _0f these 33 children, several also fit into other categories as 
illustrated in the table. Of all categories listed, only two children from the 
original list _ were still waiting to be _ served at the end of the year. 
Undoubtedly, other pupils would have _ benefited from being in the program, had 
there been _openings available. It is interesting to note that eight pupils made 
enough progress during the year that by the time the CLEAR-RR teacher could 
begin serving them, they no longer needed special help. 

Another report including data for CLEAR-Reading Recovery has been published 
by The Ohio State University (Pinnell, Short ^ Lyons , & Young, 1986). Some data 
concerning subgroups^ of pupils are slightly different due to the condition that 
the sampip n's fro^ the two reports were obtained in somewhat different ways ; 
although the data shared by both institutions were essentially the same. The 
reader should be advised that there has not been any intent to mislead the 
public. 
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Table 7 

Pupiis Served by CLEAR Reading Recovery 
N=224 





DisconLinued 


Nbri Discontinued 
i: Piiplls 


Number of tessons 


Number ^£ Pupils 


Number of Pupils 


1-9 


2 


12 


10-19 


2 


17 


20-29 


12 


12 


30-39 


8 


13 


40-49 


7 


7 


50-55 


12 


8 


Subtotal 


(43) 


(69) 


60-69 


13 


9 


70-79 


11 


4 


80-89 


13 


8 


90-99 


10 


7 


100-109 


5 


9 


110-119 


4 


8 


120-129 


5 


5 


130 


0 


1 


Subtotal 


(61) 




Total 


104 


120 
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Table 8 

CLEAR-Reading Recovery Pupils NcL Served 

N=66 



Reason Not Served 1^ umber 

Emergency Pupils 33 a, b, c 

Moved but of the System 13 a 

Transferred to Other Columbus Schools 10 b, d, e 

Too High For Service 8 

Served in instructional Aide Program 3 e 

Placed in Special Education Classes 3 c 

Waiting to Be Served 2 

Placed in kindergarten 2 d 

First-Grade Repeater 1 



a. Three Emergency pupils moved out of the system. 

bi Two Emergency pupils moved to other Columbus Schools. 

c. One Emergency pupil was placed in a Special Education Class. 

d. One Pppii transf erred to another Columbus school and wais placed 
in kindergartens 

e. Two pupils transferred to other Columbus schools and were served 
in the instructional Aide Program. 



EVALSRVCS/P501/RRFiNAL 
04/22/87 



28 



19 



Sununary/Recommehdations 

Of 2B5 pupils selected to be s_erverd in CLEAR~RR, 224 were served in the 
program in 12 schools during the 1985-85 school year. They were served by 30 
teachers with _a full-time equivalent of 16, The average number of insit ractionai 
lessons was 60.6. _ Of the total served^ 104 were discontinued and an additional 
51 had 60 or more lessons. 

The evaluation sample, consisted of 141 pupils V7ho met the criteria of being 
discontinued or_ having 60 or more lessons and v/ho received the CTBS pretest and 
posttest. Analysis, of pretest-posttest achievement data indicated that the 
evaluation sample of 141 pupils made an average, gain of 8.5 NCE points for the 
treatment period. The 98 discontinued pupils for v7hom test scores were 
available had an average gain of 1 1 . 1 _ NCE_ points . The number and percent of 
pupils who were at various percentile levels in Total Reading on the posttest 
are as follows; (a) 28 or 19.9% were at the 5_0%ile or above Xgrade level); and 
(b) 86 or 61.0% were at the 36%ile__qr below (Chapter 1 eligible). Further^ of 
the 51 pupils on whom comparable CTBS posttest data were available, only 39.2% 
(20) scored at their homeroom average on Total Reading. 

On the Reading Recovery Diag^nostic Survey^ the following mean scores V7ere 
obtained for September, and May from a sample^^ o_f 144 CLEAR-RR pupils who were 
discoritiriued or had 6i) or more instructional lessons: Letter Identification^ 
34.87 to 51.56; Word Test, 2.02_ to_ 13.24; Concepts About Print, 7.31 to 16.05; 
Writing Vocabulary^ 2.96 to 33.25; Dictation^ 5.24 to 30.16; Text Reading Level, 
1.77 to 9.53. 

CLEAR-RR pupils compared favorably to other programs _ serving first-grade 
fiypils in regard tb_ NCE g^rowth. While the. average gain for CLEAR-RR v/as 8.5 
NCE'Si regular CLEAR pupil_s_ averaged 0.9 NCE's and those in the Instructional 
Aide Program averaged 0.2 NCE's. __Hpwever^ a cost-benefit analysis of subgroups 
of pupils who scored below the 37th percentile on thel pretest, indicated that 
the cb.^t per NCE point gain was $342 for CLEAR-RR, $140 for regular first-grade 
CLEAR^ and $262 for first grade Instructional Aide pupils. 

Data regarding long term effects from early February 1987 indicated that of 
the 155 pupils who were discontinu_ed or had 60 lessons or more, 40 (25.8%) were 
retained in first grade. Also^ of the 155 pupils, 67 were in a school and at a 
grade level where a cbmpensatbry program was serving other pupils. Of the 67 
pupils > 20 (29.9%) were served in a compensatory program at that school. 

This repbrt cbhtains a considerable amount of data that compares CLEAR-RR 
with bther cbmpensatbry educatibh prbgrams. The comparative data vary based on 
the particular questibh that was bein^ addressed. (Since groups were dissimilar 
at pretest time^ sbme cautibn should be used in interpreting the results.) 
Table 9 represents _ an attempt to summarize the comparative data. It contains 
brily data fbr public schobl pupiils. The data in the table show that CLEAR-RR 
pupils did make substantial gains, in reading as measured by the CTBS test. 
Hbwever^ the program is _ very costly in terms of pupils served and NCE gain. 
This is a serious problem given the large number of Chapter 1 eligible 
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Jbprison of Cbst, CTBS Total Reading AchieveiEnti and Retention of.First^iriide 
ftibtic School Pupils in the Evaluation Sanples of 1985-86 (bmpensatoty Education Pi^aiiB 



— 


No. of 
Pupils 


I Chapter 1 
Eligible 
4/86 


Zat 
Grade. Level 
4/86 


Avg; NCE 


Avg. NCE 

t_^a_po.st-test 


Avg. NCIS 
Gain 


Cost/Pupil 
in Sanple 


Cost/Pupil 
NCE Point 
Gained 


/o ACLdJLIiCU 

in 1986^7 


Uf Retained 

ridicu III un 

by 2/87 


OM 
BparCliR 


i4t 

iea 


61.0 
42.7 


19.9 
38.8 


28.0 
43.4 


36.5 
44.3 


8.5 
0.9 


4^128 
989 


485 
1,061 


25.5^ 
23.3 


5.6% 
0.0 


tnst. Mde 


1185 


70.3 


17.0 


33.5 


33.7 


0.2 


940 


4,508 


25.9 


i.3 


mm . 

(Rpiis <37;ile 


114 


65.8 


14.9 


22.3 


34.4 


12.1 


4,128 


342 


30.7 


5,7 


00 pretest j 






















ReprClR 
(PupUs <37me 
on Pretest) 


49 


65.3 


20.4 


30.5 


37.5 


7.1 


989 


140 


32.7 


0.0 


list. Aide 


871 


76.7 


12.1 


26.9 


30.4 


3;6 


940 


262 


33.2 


1.4 



(Pupils <37me 
on Pretest) 



to Hie pupils in the evalmtion samples varied considerably across tba three prograins in terns of their 
pretest eiS I)tai teadSg scores. _The_anaiysis of pupils scoring below the 37^ile was included in 
an atteiBpt to show prtigra results on raore sindiar groups of pupils. 
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plipils aitd the limited funds that are available to serve, them. Adding . to this 
problem is the rielatively large number pf CLEAR-RR pupils who are retained in 
grade and who need additional services the following year.. The last column in 
the table indicates that few of the retained pupils V7ere placed in a program for 
the Develdpmentally Handicapped. 

It is recommended that the CLEAR-Reading Recovery program be continued 
during the 1987-88 school year, with special consideration given to the 
following: 

I. Duis to the comparative high, cost of the program, funding should remain 
at the current level until a higher percentage of pupils can be 
discontinued from the program, riot be retained in grade, and not need 
further compensatory educatiori services. 

2; The successful teaching strategies used _by CLEAR-RR teachers during 
intensive university training and fbllbw-up inservice and the 
_^^?^^t^^g development of successful pupil strategies: should be shared 
with other teachers in the Departmerit of Federal arid State Programs. 

3; The possibility of providirig service to more pupils should be 
investigated. It is possible that, as teachers become better trained, 
they will be able to accelerate the_ progress of pupils to the extent 
that they can be discdritiriued earlier so that others will have an 
opportunity to be served. As the program exists now, too many are in 
the program for almost the entire year. 

4; The problem of hig.. retention rate in grade 1 needs to be explored. 
If classroom teachers are retairiirig pupils who have made dramatic 
improvement at the end of the year^ perhaps closer communication 
between principals , CLEAR-RR persoan^l^ arid other staff members would 
result in a clearer unders tariding of the level of success of CLEAR-RR 
pupils. If, however, large percentages of pupils _ continue to qualify 
for Chapter I programs, earlier ideritif ication of pupixs who may be 
eligible for special education services may be in order. 
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